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Abstract. Let Y be a subvariety contained in a smooth Mumford compact- 
ification of an orthogonal Shimura variety M C A g , where A g is the moduli 
space of principally polarized abelian varieties of dimension g with some level 
structure, such that Y intersects the boundary of A g transversally. Then we 
give necessary and sufficient conditions of Andre-Oort type for Y itself being 
the compactification of a special subvariety Y° C M. 

Introduction 

Let A g := denote a fine moduli scheme of principally polarized abelian 

varieties of dimension g with a level iV-structure, for some N > 3. We choose in 
addition a smooth compactification A g = A g U S with normal crossing divisor S 
as constructed by Mumford [7]. We denote by / : X — > A g the universal family 
of abelian varieties and by V = i? 1 /*^ the VHS attached to it. We assume that 
the monodromies of V around all components of S are unipotent (i.e., iV >> 0) 
and look at a smooth, projective subvariety Y G A g meeting S transversally. 
A subvariety Y° C A g is called special, if Y° = T\G(R)/K is locally symmetric 
and induced from some Q-embedding G Sp 2g of a Hermitean type algebraic 
group G [1]. The Andre-Oort conjecture asserts that Y° is a special subvariety 
if and only if it contains a dense set of CM points. Since we are using Hodge 
theory, we are not able to deal with points effectively. However the Andre-Oort 
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conjecture would also imply that the closure of any union of positive dimensional 
special subvarieties is again special. 

One of our goals is therefore to support the Andre-Oort conjecture by looking 
at subvarieties like Y with dim(Y~) > 2 containing sufficiently many special sub- 
varieties of dimension > 1. In [6] we used special divisors W® C Y° satisfying 
Hirzebruch-Hofer proportionality (HHP) with % G I, a finite index set. Condition 
(HHP) is an equality condition arising from an inequality which in turn has its 
origin in natural stability conditions for Higgs bundles. Under these assumptions 
we showed in [6] that Y° is special if Jj/ exceeds some effective bound. How- 
ever, we had to assume in addition that Y° is contained in a Shimura subvariety 
M C A g of orthogonal type: 

Theorem (Thm. 3.2. in [6]). Under these assumptions one has: 

(i) // the W? are of type SO(d - 1, 2), for all iel, if they satisfy (HHP) 

Vu Wi {s Wi )(N Wi/Y ) = Puw.iSwjiTw^-logSw.)), 

and if #1 > q(Y) := (p + 5) 2 + p + 5 + 1, then Y° C M is a special 
subvariety for SO(d, 2). 

(ii) Assume that the Griffiths- Yukawa coupling vanishes on Y. If the Wf are 
special subvarieties of type SU(d — 1, 1), if 

feSw w .(s Wi )( N Wi/Y) _ deg^ {Swi ) (T w . (-\ogS w J) 
rankNyy./Y d+1 

and if #1 > s{Y), then Y° C M is a special subvariety for SU(d, 1). 

(iii) Let Y be a surface and I = {1,2}. Assume that 

<7i(Wi)n<7 2 (w 2 )^0 

and deg N\y t /Y = for i = 1, 2. Then Y° is the product of two Shimura 
curves. 

Here N w / Y denotes the logarithmic normal bundle T Y (— log S)/T w {— log S) of 
a subvariety W C Y intersecting S transversally. p denotes the Picard number 
of Y and 5 the number of crossings of S D Y. The Griffiths- Yukawa coupling 
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on a subvariety Z C M intersecting S transversally is defined as the iterated 
Kodaira-Spencer derivative 

E 2 ' — y E ' 2 <g> S 2 £l 1 z (\ogS), 

where, as always in this paper by abuse of notation, the same letter S also denotes 
the intersection of any transverse subvariety with S. In this paper we remove the 
divisor hypothesis and obtain the following necessary and sufficient conditions 
supporting the Andre-Oort conjecture: 

Theorem 3.4. Assume that Y° is contained in a Shimura subvariety M C A g 
for the orthogonal group SO(2, n) and that Y can be covered by a smoothing of a 
cycle Yli a iC'i of special curves C{ C Y satisfying (HHP). Then: 

(a) IfW yof zY = W y0 (zY,wi®C for some y G C\ then Y° C M is a special subvariety 
of orthogonal type. 

(b) If the Griffiths- Yukawa couplings along all Ci do not vanish then Y° C M is 
a special subvariety of orthogonal type. 

(c) If the Griffiths-Yukawa coupling along Y vanishes then Y° C M is a special 
subvariety of unitary type, i.e., a ball quotient. 

In the proof we use the algebraic monodromy group H(Y°), i.e., the Q-algebraic 
closure of the monodromy representation restricted to Y°. This is a subgroup of 
Hermitean type in SO(2, n). Hermitean subgroups of SO(2, n) like H(Y°) can be 
classified. Besides the obvious orthogonal and unitary subgroups which are Q- 
simple there are SL 2 x SL 2 and quaternionic versions [H Thm. 5.2.3.]. The reason 
is that non-Q-simple subgroups lead to non-rigid sub-VHS in the universal VHS 
of weight two over M. In the non-Q-simple cases we therefore have dim(Y") = 2 
and Y° is uniformized by a product HI x H of upper half planes. 
This work naturally continues the results in [6]. Together with Eckart Viehweg 
we have thought about thickenings of Higgs bundles during a stay at Fudan 
University in the summer of 2007. Thickenings play an essential role in this 
paper which therefore should be considered as joint work with Eckart. 
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1. Basic Setup 

In this section we will use the Simpson correspondence between polystable (log- 
arithmic) Higgs bundles and local systems, see [TO] . 
Consider a non-singular projective curve C and a non-constant morphism 

<p:C^YcA 9 , 

such that C° := ^~\Y Q ) ^ 0. 

If C° — > A g is a Shimura curve, then by pjj], after replacing C° by an etale cover, 
the local system W := y^-R^C admits a decomposition 

W=L©TffiU 

as polarized C— VHS on C°. Here L is of weight one and rank two with corre- 
sponding Higgs bundle 

(£ © C-\ r : £ ~ /T 1 © ^(log 5)) . 

T is concentrated in bidegree (0, 0) and selfdual, whereas U is of weight one and 
decomposes in two local subsystems 

U = U 1 ' © U ' 1 , U 1 ' = U°' lv . 

Writing T and U ©W v for the corresponding Higgs bundles, then the Higgs bundle 
corresponding to W decomposes in the form 

(1.1) (E 1 ' © E ' 1 , 9) = (C® C-\ r) © (T, 0) © (U, 0) © (W v , 0). 

Let E = E 1 ' © E 0,1 denote the logarithmic Higgs bundle corresponding to 
Deligne's canonical extension of V © ®A g - The Higgs map is given by 9 : E 1 ' — > 
E ' 1 © fl\ (log S). Since V is a polarized VHS, there is a natural isomorphism 
End(E') E® 2 . Then it is well-known [3] that the composition 

T^-logS) A End(£) 4 E m ->■ S 2 (E 0,1 ), 

identifies T% (— logS 1 ) with S 2 (E 0,1 ). Pulling back this isomorphism to Y via 
if : C — > Y we obtain an inclusion 

T c (-logS) ->• V *T Y {-\ogS) ^ S 2 (E°> 1 ) = £- 2 ®S 2 (T)®C- l ®T®U v ®S 2 (U v ), 
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where the decomposition on the right side is induced by ( 11. li and is orthogonal 
with respect to the Hodge metric. All three summands are polystable by [9], but 
with different slopes 

degTc(-fogS), ^degT c (-logS) and 0. 

As 9 on C preserves the decomposition ( II. ip the image of Tc{— log S) is contained 
in £~ 2 © S 2 (T) as a direct factor isomorphic to C~ 2 . Let 

N c/Y = (p *T Y (-logS)/T c (-logS) 
denote the (logarithmic) normal bundle of tp : C — > Y and 

N c/J[g = ip*T-j g (-\ogS)/T c (-\ogS) 
the one for C — > A g . Then the decomposition 

S 2 E°' 1 \ G = T c {- log S)® (C~ 2 © S 2 {T)/T C {- log Sj) © (CT 1 © T <g> W v ) ©S 2 (W V ) 
induces a decomposition 

(1.2) <^*T y (- log 5) = iVc/y © r c (- log S). 

Now consider the quotient map 

N C /Y JV c/3fl = £~ 2 © S 2 {T)/C- 2 ®C- 1 © T © W v © S 2 (W V ). 

The decomposition on the right side corresponds to the Harder-Narasimhan fil- 
tration 

such that 

jV° /3g = £- 2 © S 2 (T)/£- 2 , N 1 ^ = C,- 2 © S 2 (T)/C- 2 © /T 1 © T © U y . 
Taking the induced filtration on Nq/y by intersection 



one finds subbundles 



C N c/Y C N l c/Y C N 2 /Y = Nq/ y , 



N c + /Y /N c/Y C N^JN^- A . 
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Since N l +L /NX is polystable, we arrive at the following definition: 

C/Ag Ag 

Definition 1.1. <p : C — > Y satisfies relative Hirzebruch-Hofer proportionality 
(HHP) if the slope inequalities 

KN^y/N^y) < KN^JN^J, i = 0, 1, 2 

are equalities. One has K^JN 1 ^) = fi(S 2 (U v )) = 0, ^(N^JN^) = 
^{C- l ®T®W) = i cleg T c (- log S), since C~ 2 = T c (-\ogS) and li(N^J = 
/j(C- 2 <g> S 2 (T)/C~ 2 ) = degT c (- log S). Hence, we obtain 



H(N% /Y /Nh /Y ) < 0, 

f 
2 



^y/N^y) < idegT c (-log5), 



M^/y) < degT c (-lo gl S). 

Combining all three inequalities we obtain a single inequality 

rank(M /v ) - rank(iV° /v ) + 2 
(1.3) degN c/Y < C/YJ degT c (- log S). 

It satisfies equality if and only if (HHP) holds. 



Proposition 1.2. 

(i) If ip : C — >■ Y satisfies (HHP), then p*Ty(— log S) is a direct factor of an 
orthogonal decomposition of ip*Tj (— log S) with respect to the Hodge metric. 

(ii) If Y° C A g is a special subvariety, then (p*T Y (—logS) is a direct factor of 
an orthogonal decomposition of ip*T-j (— log 5) with respect to the Hodge metric 
and ip : C — >■ Y satisfies (HHP). 

Proof, (i) Assume the relative proportional inequality is an equality, then the 
polystability of N^L /N^ implies that 

C/Ag Ag 

Nff Y /N h/Y C N^jN h/ - Ag 

are direct factors. Since 

C/Ag C/Ag' C/Ag C / Ag ' 



using the commutative diagramm 



AT 



N° - 

C/A g 



N 1 - 

C/A g 



N, 



C/Y 



N C,A 3 



we obtain 

N c /y = N° c/Y © N^ /Y /N° c/Y © N c/ y/N^ /y , 

which is a direct factor of N C /-j with respect to the Hodge metric. By ( 11. 21) we 
are done. 

(ii) Y° C A g is complete and totally geodesic, therefore by a theorem of Mok [5] 
one obtains a splitting for T Y o C |yo which is orthogonal with respect to the 
Hodge metric. 

Note that this splitting holds in the category of locally homogeneous vector 
bundles over Y°. Now we pass to the canonical extensions T Y (—logS) and 
Tj (— log S)\y of Mumford, which are unique [3]. Hence we obtain a splitting for 

T y (- logs') CTjJ- log S)\ Y , 

which is orthogonal with respect to the Hodge metric, thus a splitting of 

< P *TY(-logS)c<p*T Ag (-logS). 

Since if : C° — > A g is a Shimura curve, one has the decomposition 

<p*Tj g (- log S) ~ S^E ' 1 ) = C~ 2 © S 2 (T) (BC- 1 © T ®U W © S 2 {U W ) 

of polystable subbundles, which can be decomposed further as the direct sum of 
stable subbundles. 

<p*T 1Lii {-]QgS) = K 1 @...@K l . 

By a theorem of Atiyah j2] the category of vector bundles over any compact com- 
plex manifold is Krull-Schmidt, i.e., in our case if there is a second decomposition 



^T^(-logS) = K[®---®K[ l 



8 STEFAN MULLER-STACH AND KANG ZUO 

of irreducible subbundles, then up to a permutation one has 

Ki ~ K[,. 

This shows that <p*T Y (— log S) is the direct sum of some direct factors of £~ 2 <g> 
S 2 (T), C^ 1 (g) T ®U y and S 2 (U V ) and therefore the relative proportionality in- 
equality (jl.3p is an equality. □ 

By Proposition 11.21 the inclusion ip*T Y (— log S) C ip*Tj (— log 5*) is compatible 
with the decompositions 

<p*T Y (-]ogS) = T c (-\ogS)®N c/Y = T c (-\ogS)® & l=0 N l c + /Y /N* c/Y 

n n n 

^(-log5)= T c (-logS)©A/ cA) = T c (-logS)© ©L^/^/a, 

Example 1.3. If K is a Shimura surface, then Nc/y is a line bundle and there 
are three cases in which we write (HHP) in terms of more familiar intersection 
numbers, see [6]: 

(i) Y is a Hilbert modular surface: 

N c /y = N° c/y c:C- 2 ®S 2 {T)/C~ 2 , (HHP): u Y (S) ■ C + 2C 2 = 0. 

(ii) Y is a Picard modular surface: 

N C /Y = N^ /Y /N^ /Y C C- 1 ® T g) W v , (HHP) : co Y (S) ■ C + 3C 2 = 0. 

(iii) K is product of two Shimura curves: 

Nc/Y^N^y/N^yCS 2 ^), (HHP): C 2 = 0, 
and C lies in the fibres of one of the projections. 

Question 1.4. Does the (HHP) for a Shimura curve (f : C — > Y C A g imply 
that Y° C A g is a special subvariety, if we assume that H(Y°) is Q-simple ? 

This question seems to be very optimistic and at the same time difficult to answer. 
However we are not aware of any counterexamples if H(Y°) is Q-simple. It is our 
goal to show that the existence of "many" special curves, e.g. a dense subset of 
such satisfying (HHP) forces Y° to be a special subvariety. 
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Remark 1.5. Consider the situation <p : C — > Y C A g , where Y° C A s is a 
special subvariety and (p : C — > Y an arbitrary curve. Then one obtains an 
inequality opposite to ( 11 .3D . see [6]. 

2. Thickening of the Higgs field 

We use the same notation as in the previous section, in particular p> : C — > 
Y C A g is a Shimura curve. This implies that there is a splitting <^*fiy(log S 1 ) = 
Q l c (\ogS)®N^ /Y , see (O]). 

Definition 2.1. We define the thickening of the Higgs field 9 on C in the normal 
direction N c /y as the pullback of the Higgs bundle on Y via <p : C — > Y: 

9 C/Y := <p*e : E 1,0 -> E ' 1 ® ^O^logS) = E ' 1 <g> (^(log5) © J\$ /y ). 

In the same way we define the thickening of the Higgs field in a point p e C in 
the normal direction iV p /y as 

P/Y ■= C/Y \ P ■■ E l \ -> ^^^(logS^ = £;°' 1 | p g)(^(logS')| p ®^ /y | p ). 

Consider the fc-fold tensor product 9)® k of the Higgs bundle (E, 9) on Y\ It 
decomposes clS cl direct sum 

p+<j=fc 

where 

E p ' q = ® • • • ® 

and where the sum ranges over ^ + g» = 1, X^=iP« = Pj Si=i 9» = 1- The Higgs 
field, again denoted by 9, decomposes as 

9 : E p ' q ^ E p - l ' q+l ® tt Y (logS 1 ), 

where 

fc 

£ Pl ' 91 <g> • • • ® A g> • • • <g> ^p*- 1 '^ 1 <g) . . . ® E Pfe,9fc ® fi y (logS) 

1=1 
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is defined by the Leibniz-rule 

it 



9\ E pi,<n®...®EPk'ik = id ® • • • <g> ^i,o <8> • • • ® id. 



i=l 



In the same way as in the definition above we define the thickening (E,6c/y) 
and (E, e p/Y )® k . 

Given a base point y G F (y could lie on the boundary S) we consider 

where carries the induced real structure from y® fc . We define the following 
real subspace of E v y > v n Vf * 

ker(^ y ) M := {t G £7 n Vg | 9™ Y (t) = 0}. 

Assume now for a moment that Y"° is a locally symmetric space, i.e., a quotient 
of a bounded symmetric domain. Then it is well known that Q y0 , and all Hodge 
bundles Eyl are locally homogeneous vector bundles. Furthermore, the Higgs 
map 9 Pt9 : Eyo — > E p ~ 1,<1+1 \yo <8> fiyo is an equivariant morphism between lo- 
cally homogeneous vector bundles [I]. We decompose Eyo as the direct sum of 
irreducible locally homogeneous subbundles 



E Y° - (J) E Y 



i 

Y°,i- 



Then we take Mumford's canonical (good) extensions Ey\ [Tj of those irreducible 
locally homogeneous subbundles, and we use the same symbols 

i 

for the extended decomposition by uniqueness of good extensions. 
The complex conjugation 

V c V c 

induces also a complex conjugation on the Deligne extensions of V := V ® Oco 
and sends E™ to E Q y P (~ £ y '" v ), hence Ey\ to E™ (~ Epf ). 
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Definition 2.2. Given a base point y EY (y could lie on the boundary S), then: 

(a) W yeY ■= {tEE p y p \6 yeY (t) = 0}. 

(b) A tensor t E E p ' p D V^ k y is called a real Hodge tensor at the base point y EY . 

(c) WW := {* e ^ P ' P n I W(0 = o}. 

Remark 2.3. It is clear that W^g^R ®Cc W ye y, but in general they are not 
equal. 

Proposition 2.4 (Parallel Transport). There exists a unitary subsystem W C 
V® fc of pure Hodge type (p,p), which naturally extends to Y , carries an induced 
real structure from V® fc and such that Wr iS = W^gy^ /or all y E Y . 

Proof. From the above discussion we know that E Y ,V decomposes as direct sum 
of good extensions of irreducible locally homogeneous subbundles 

i 

Since 9 P,P : E p ' p — > E p ~ 1,p+1 ® £l Y (\ogS) is a morphism between good extensions 
of locally homogeneous vector bundles, ker(# p ' p ) is again a direct sum of good 
extensions of locally homogeneous subvector bundles, which are Higgs subbundles 
(with trivial Higgs field) of (E, 9)® k . By Simpson's polystability all of them have 
non-positive slopes. We decompose 

ker{6 p ' p ) = ker(e p ' p ) © ker(^) <0 , 

where ker(# p ' p )o is the direct sum of good extensions of locally homogenous sub- 
vector bundles of slope zero and ker(6 |p ' p ) <0 is the direct sum of good extensions 
of locally homogeneous subvector bundles of negative slopes. By Simpson's corre- 
spondence ker(6 )p ' p )o underlies a unitary local subsystem W C V® fe of type (p,p). 
ker(# p ' p ) is invariant under complex conjugation induced by the real structure on 
V 8 ^. This can be seen as follows: the complex conjugate ker(# p ' p ) corresponds to 
the complex conjugate W of W, which is again a unitary sub local system of type 
(p,p). Hence it vanishes under the Higgs field # p ' p , i.e., ker(# p ' p ) C ker(# p ' p ). Note 
that ker(# p ' p ) is again the direct sum of some good extensions of locally homo- 
geneuos subvector bundles of slope zero, hence we obtain ker(6 lp ' p ) C ker(6 |p ' p ) . 
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Clearly for all real vector t G ker(9 p ' p ) Qty we have 9 p ' p (t) = 0, so t G W yeY ,R- Con- 
versely, let t G W y( zY,R. Then t is a real vector in kei(9 p ' p ) y . There are no vectors 
in ker(6 p ' p ) <0 ^ y fixed by complex conjugation, because complex conjugation takes 
negative slopes to positive slopes. Therefore t is a real vector in ker(# p ' p ) 0ir Thus 
we have shown 

W K)W = ker(^) 0Aj/ = W yeYJt . 

Since V®* has unipotent local monodromies around S and W is unitary, the local 
monodromies of W are trivial around S. Hence W extends across S. □ 

Remark 2.5. For a rational Hodge tensor t G W y€Y , t is contained in a unitary 
local subsystem with a Z— structure. Hence the orbit 

{p(l)(t)\ 1 en 1 (Y°,y)} 

is finite. 

For a Shimura curve C° C A g we can describe the above decomposition more 
precisely. For the Higgs bundle E one has 

where C®T and ®T are polystable of slopes deg C and — deg C respectively. 
Moreover if U ^ then U and U y are both polystable of slope zero. So one 
obtains: 

Lemma 2.6. The sheaves E p,q are direct sums of polystable sheaves E p,q of slopes 
fi(E p,q ) = idegC and one has: 

(a) IfU = 0, then E™ ^ if and only if i = p - q, and E p > q = E p > q . 

(b) IfU^O, then E p ' q ^ if and only if i G {— q, ■ ■ ■ ,p}. In this case E p ' q is a 
direct sum of sheaves of the form 

fcj The sheaf E™ is dual to E p _! p . 
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Consider the decomposition ( 11. 2ft 

<p*T Y (- log S) = N c/Y © T c (- log S). 
The assumption that (p : C — > Y satisfies (HHP) implies the decomposition 

N C /Y = N° c/Y © N c/Y /N° c/Y © N 2 C/Y /N C/Y , 

such that 

N c/Y c N° cfAg = £~ 2 © S 2 {T)/C- 2 c Uom{C © T, C~ l © T)//r 2 , 
N X C /y/ n c/y C N l cf zjN cfJg = C" 1 © T © W v = Hom(£ © T, W v ) 

and 

Nc/y/Nh/y C N^JN^ = S 2 {W) C Uom{UM y ) 

are direct polystable factors of slopes —2 deg £, respectively — deg £, respectively 
0. In this way we may decompose the thickening 8c/y in the form 

9c /y = 9c + 9n c/y = 9c + 9 N ° C/Y + & n^ /y /n° /y + & n^, /y /n^ /y - 
Using that decomposition we obtain: 

Lemma 2.7. The thickening 9c/y on E V L A can be decomposed as a direct sum of 
morphisms: 

E™ ^ EC}** 1 © (^(log S) © N C ) Y ), 



and 



C/Yl ly C/Y) ■ 



Ef A ° /Y C/y > ^r 1,9+1 ® (JVS/y/^c 
between polystable sheaves of the same slopes. 

Proof. Write 

E 1 * = £©r©w, e ' 1 = c- l ®r@u y , 

then #cyy : E 1,0 — >■ i? ' 1 © <£>*f2 y (log S") decomposes into the following terms: 

£ © r ^> /r 1 © r © i^(iog 5), 
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V 

C®T — ^» CT X ®T '<g> Ntyy, 
C®T ^ /y/JV&/y ) W v ® (A^ /y /iV° /y ) v 

and 

0^,2 /JV 1 

w c/y c/y > W v ® (iV^ /y /iVi /y ) v . 

This proves the lemma for the case k = 1. In general, one reduces the cases /c > 2 
to the case k — 1 using the fact that the thickening 0®^ y is defined by the Leibniz 
rule. □ 

3. Parallel transport of real Hodge tensors on connected 

cycles of special curves 

Let Y C A g be a smooth, projective subvariety, which meets S transversally. 
Assume Y contains a connected cycle ^ Q of compactified special curves, such 
that each of them meets S transversally and satisfies (HHP). Using base points 
t/i G C° we introduce the following subspaces: 

W yi& := {teE™\9 yieY (t) = 0}, 

n 

w meCi ■= {teEg>\e vieCi (t) = 0} 

and the real spaces 

WW ■= {teEtfnvpU W*) = o}, 
n 

W^C* := {*G^nV|*| tt |fl w6C( (0 = 0}. 

Fixing a base point y\ G C° we now need to study the parallel transport of real 
vectors in W yie y,R along paths in the connected subspace ^2 i C i . 

Proposition 3.1. (a) The real subspace W Vi€ y,r C Vf fc is invariant under the 
monodromy action p^ k (^liJ^i ^ii Ui))- 

(b) Assume that E^f is polystable of slope zero for all C; L . Then W yie y is invariant 
under the monodromy action p lX,fc (vri(^ i Cf, yi))- 
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Proof, (a) We have the decomposition 

Oyi/Y = <V/Ci © Noi/Ym . 

Hence, 

W yieY ,M, = { t e W yie ci,M, 1 Nci/Ym = }. 

By Proposition 12.41 there exists a unitary subsystem C Vjf fc of Hodge type 
(p,p) such that W yieCl ,m = W Cll!n . 

Let Wd C denote the polystable subbundle of slope zero corresponding to 
W^. Then by Lemma [27T1 

is a morphism between polystable bundles of slope zero. Hence the kernel 
ker(^ Ci/r : W Cl -> 9n Ci/y (W Ci )) =: W Cl 

is a polystable subbundle of Wei of slope zero. Therefore it underlies a unitary 
subsystem W Cl C <8> C. From the construction of W' Cl we see that 

W yieY)R G W' Cuyi . 

We start with a real vector t\ G W Vi& y,r and denote by t 2 the parallel transport of 
t\ as a vector in the fibre of the local system along some path in C° from y\ 
to y 2 G CjnCj . Since ti is contained in the fibre of the subsystem C V® ^ 
at yi, t 2 is a real vector (because of the real structure on V® fc ) and contained in 
the fibre of W' c at y 2 - By the construction of , we see that O y2 /c 1 {t 2 ) = 
and 9 Nci/Yt y 2 (t 2 ) = 0, i.e., t 2 G W y2eY ,TS,- 

Regarding y 2 G C 2 we repeat the above argument and continue the parallel 
transport of t 2 along some path in C 2 from y 2 to ys G C^nC^ etc.. This shows that 
W yie y,R C Vjf^ is invariant under the monodromy action p (glfc (vri(^ i C°, yi))- 
(b) Since £^ is polystable of slope zero, ker(6^f) is a Higgs subbundle of slope 
zero (with trivial Higgs field) and it corresponds to an (extended) unitary local 
system Wc, C V®^ with an induced real structure, and such that Wc llS = W ye ci 
for all y G Ci. Since W yie y = G W yie ci \®N C /y>vitf) = 0}> by the same 
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argument as in (a) we find a unitary subsystem C such that W Cuy = 
W y( zY for all y G C\. The rest of the proof is exactly the same as in (a). □ 

Proposition 3.2. Assume that the geometric monodromy group H(Y°) defined 
in the introduction of Y° is Q-simple. Assume that the cycle Y2i Ci n^^ets S 
transversally and that a suitable linear combination a^Cj of special curves Ci 
satisfying (HHP) can be deformed to a generically smooth family of curves U z& zC z 
filling out Y , i.e., ^ a^Cj is a degenerate fibre of a generically smooth family of 
curves U z ^zC z over a base scheme Z . We also fix a base point yo G C°. 

(a) Then W yi£Y ,R C V® fe yi is p® fe (7n(Y° \y )) -invariant. 

(b) Under the assumption in Prop. GO (b) W yoeY C is p (g>k (ir 1 (Y ,y ))- 
invariant. 

If the assumptions of Proposition 13.21 are satisfied we say that Y° can be covered 
by a smoothing of a cycle Yli a i^i of special curves Ci satisfying (HHP). 

Proof, (a) Fix a smooth curve C z in the family U 2g zC z and a base point * G C z . 
Then C° deformes to ^ OiC? and * moves to y G C? along a path 7^. This 
implies that any loop lying on C° z with base point * is homotopic to some loop 
lying on J2i with base point yo- By Proposition 13 . 1 1 the induced representation 

pes ^Vf* 

stabilizes the real subspace of W* C which is the parallel transport of W yo ^y 
along the path 7"^. 

After blowing up and removing some subvarieties of Y° (note that those modi- 
fications do not change the algebraic monodromy group H(Y )) we may assume 
that the family gives arise to a smooth fibration g : Y° — > Z° with smooth fi- 
bres C°. The homotopy exact sequence of a smooth fibration shows that the 
image 7i"i(C°, *) — >■ iri(Y°, z) is a normal subgroup. Hence H(C®) C H(Y°) is a 
normal, algebraic subgroup. Using semi-simplicity, we may decompose H(Y°) as 
the product of H(C®) with another Q— factor. But, by assumption, H(Y°) is Q- 
simple, so we obtain H(C®) = H(Y°). Since p®o stabilizes W*, which is indeed an 
algebraic condition for the monodromy matrices of pco the representation H(C®) 
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in Yf k also stabilizes W*. This shows that p® k (n^Y , *)) stabilizes W*. Now 
by moving the base point * along the path j* yo to yo we obtain that W vo£ y,r is 
p® fc (7ri(y°, ?/o))-i n variant. The proof of (b) is the same as the one of (a). □ 

Corollary 3.3. Assume W Vo ^y carries a Q- structure from V® fc . Then the sub- 
system Uyo has finite monodromy and W yo ^.y extends to a subspace of sections of 

We assume now Y° is contained in a Shimura subvariety M C A g of orthogonal 
type. Then Vff contains a sub-VHS of Hodge structures V, whose corresponding 
Higgs bundle has the form 

E = E 2 ' © E 1 ' 1 © E ' 2 , 9 2 ' : T w (- log S) © E 2,0 ~ E 1 ' 1 , = # 2 - 0v . 

The Griffiths- Yukawa coupling for i? along any subvariety Z C M meeting S 
transversally is the iterated Kodaira-Spencer derivative 

E 2 '°^E°' 2 ®S 2 n l z (logS). 

The following statements and proofs will refer to this notation. 

Theorem 3.4. Assume that Y° is contained in a Shimura subvariety M C A g of 
orthogonal type and that Y can be covered by a smoothing of a cycle £\ OjCj of 
special curves Ci C Y satisfying (HHP). Then: 

(a) IfW yo£ Y = W / l/oe y > iR©C for some yo G C\ then Y° C M is a special subvariety 
of orthogonal type. 

(b) If the Griffiths- Yukawa couplings along all Ci do not vanish then Y° C M is 
a special subvariety of orthogonal type. 

(c) If the Griffiths- Yukawa coupling along Y vanishes then Y° C M is a special 
subvariety of unitary type, i.e., a ball quotient. 

Proof. Y° is contained in M, which is a Shimura variety for the orthogonal group 
SO(2,n). All Hermitean type subgroups of SO(2,n) except G = SL 2 x SL 2 and 
quaternionic versions (see jH]) are Q-simple for rank reasons and either orthogo- 
nal or unitary. Hence H(Y°) will be Q-simple unless dim(y) = 2. In that case 
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it follows that Y° is is uniformized by a product EI x EI of upper half planes. 
For the rest of the proof we may therefore assume that H(Y°) is Q-simple and 
dim(F) > 3. 

(a) By Prop. 13.21 (a) the real subspace W vqG y,r is P® 2 {ki(Y°, y )) -invariant. Hence 
Wy o£ Y,R ® C defines a unitary subsystem of Y YC and a corresponding decompo- 
sition of Higgs bundles 

(E Y fi © Ey 1 ' © E /, 6 Y ) © (Ey 1 " , 0), 

where 

i i" 

rankEy = dim W vo& y,r © C = dim W yo ^y — dim M — dim Y. 
This implies that 

9 Y : T Y (- log S) © Ey° ->■ E^ 1 ' 

is an isomorphism. Hence F° C M is a totally geodesic embedding and of orthog- 
onal type. Together with the rigidity of Y° C M, which follows from dim(y) > 2 
[6] , we obtain Y C M is a special subvariety of orthogonal type by the arguments 
in p. 

(b) We will give two proofs. First Proof: The non-vanishing of the Griffiths- 
Yukawa coupling along Cj implies that 

Y' c . = V" ©U 1 ' 1 , 

where V" is a sub-VHS with rank one Hodge bundles Eg? © Eq © Ejr and 
Uq. is a sub-VHS of pure Hodge type (1, 1). Hence Eq. is polystable of slope 
zero. Fix a base point yo e C°. Then by Proposition 13.21 (b) the subspace 
W yo£ Y C "V^ is p® 2 (7T 1 (F°, ?/ ))-i n variant. Hence the Higgs bundle E associated 
to Y'y decomposes as 

(E Y fi © E 1 /' © £ y ' 2 , 6 Y ) © (E^ 1 ", 0), 

where the Higgs subbundle (Ey 1 , 0) corresponds to the unitary subsystem of 
rank equal to dim M — dim Y defined above. This implies that 

6 Y : T Y (- log S) © E Y fi -> Ey' 1 ' 
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is an isomorphism. As in (a), Y° C M is a totally geodesic embedding and the 
rigidity of Y° C M implies that Y° C M is a special subvariety of orthogonal 
type. 

Second proof for (b): Let (Fy, 9 Y ) C © Fy' 1 © £y' 2 , 0y) denote the unique 

saturated Higgs subsheaf generated by and 9 Y . Then F Y '° = E Y fi and F°' 2 = 

2 

', since the Griffiths- Yukawa coupling does not vanish. The no n- vanishing of 
the Griffiths- Yukawa coupling along Cj implies that 

y' Ci = feu 1 ' 1 , 

where V" is a sub-VHS with rank one Hodge bundles 

E% © Eg © ^ 

and Uq 1 is a sub-VHS of pure Hodge type (1, 1). Using condition (HHP) for 
Ci CY we see that 

= 9 Ci (T Ci (-\ogS)®E^)®9 Nci/Y (N Ci/Y ®E 2 d °) 

where 9 Nc/Y (N Ci / Y <S>E^) is a direct factor of Uq. In particular det(F y ' 1 ) • Cj = 
0. Hence, det(F y ' i ) -C z = 0, where C 2 is a smooth curve in the family Li ze zC z and 
meets S transversally. Note that deg Fc z = 0, and by Simpson's polystability for 
the logarithmic Higgs subsheaf F Cz ,9 Cz C (£$° © E^] © E%?,0 Cz ) we obtain a 
corresponding sub-VHS C V^. . Since H(Y°) is Q-simple, the same argument 
as in the first proof of (b) shows that V^ z extends to a sub-VHS over Y°, which 
uniformizes Y° as a special subvariety of orthogonal type. 

(c) The vanishing of the Griffiths- Yukawa coupling on Y implies that the Higgs 

2 

subsheaf generated by E Y ' and 9y has the form 

(F Y ,9 Y ) = (E Y fi ®9 Y (T Y (-\ogS)®E Y fi ),9 Y ). 
Therefore one has 

9 Y (T Y (- log S) © E 2 /) © Cl = 9 Ci (T Ci (- log S) © E%°) © 9 Nci/Y (N Ci/Y © E%°). 
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Note that in this case 

where U 1 ' 1 is polystable of degree zero and such that 

B Ci : T Ci {-\ogS) <g> C-^C~\ with C- 1 = e Ci (T Ci (-logS)®E 2 ^). 

The condition (HHP) for all Cj just means that Q Nc /Y (N Ci /Y ® ^c!) * s a direct 
factor of U 1 ' 1 , hence it has degree zero, too. That implies that det Fy ■ C{ = 0. By 
the same argument as in (b) we obtain that (Fy,6y) corresponds to a sub-VHS 
over Y°, which uniformizes Y° as a special subvariety of unitary type. □ 

Remark 3.5. It is not hard to show that the assumptions of the theorem are 
necessary, since by Borcherd's results any orthogonal Shimura variety contains 
complete intersections of ample hypersurfaces which are unions of orthogonal 
special subvarieties and components of S. 
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A CHARACTERIZATION OF SPECIAL SUBVARIETIES IN 
ORTHOGONAL SHIMURA VARIETIES 



STEFAN MULLER-STACH AND KANG ZUO 

Fur Eckart, in Freundschaft und Dankbarkeit 

Abstract. Let A g be the moduli space of principally polarized abelian va- 
rieties of dimension g with some level structure and M° C A g an orthogonal 
Shimura variety. We consider a smooth toroidal compactification M of M° and 
a subvariety Y C M intersecting the boundary of M transversely. Then we 
give necessary and sufficient conditions of Andre-Oort type for Y itself being 
the compactification of a special subvariety Y° C M°. 

Introduction 

In this paper we want to study a certain weak form of the Andre-Oort conjecture 
extending our previous work with Viehweg [19] . In order to explain our results 
we first want to introduce the required notation. 

Notation. Let A g := Ag denote a fine moduli scheme of principally polar- 
ized abelian varieties of dimension g with a level iV-structure, for some N > 3. 
We choose in addition a smooth toroidal compactification A g as constructed by 
Mumford et al. [1, chap. Ill], such that S = dA g is a divisor with normal cross- 
ings. We denote by / : X — > A g the universal family of abelian varieties and 
by V = i? x /*Q the local system attached to it. There is a polarized variation 
of Hodge structures (VHS) defined over Q with underlying local system V which 
we also denote by V. The assumption N > 3 implies that the monodromies of 
V around all components of S are unipotent. We consider a smooth projective 
subvariety Y <Z A g meeting S transversely and define Y° := Yf] A g . Throughout 
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Key words and phrases. Andre-Oort conjecture, Shimura variety, local system, Higgs bundle. 
Supported by SFB/TRR 45 der Deutschen Forschungsgemeinschaft 2007-2011, Fudan Uni- 
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this paper we denote subvarieties contained in the locally symmetric part A g of 
A g with a superscript 0. 

Write (GSp2 g , H g ) for the pure Shimura datum defining A g = A g with level 
structure given by the compact open subgroup K(N) of GSp2 g (Af). By spe- 
cial subvariety of A g we mean, as is defined in jTUj and [HI 6.2], a geometri- 
cally irreducible component of a Hecke translate of the image of some morphism 
ShxiG, X) —¥ A g = SfiK(N)(GSp2g, H g ), which is defined by an inclusion of 
Shimura subdatum (G, X) C (GSp 2g , H g ) together with some compact open sub- 
group K C G(Af) such that K C K{N). More concretely, we abuse the nota- 
tion A g = T(N)\H g h for a fixed connected component of StiK(N)(GSp2 g , X), and 
we mainly work with subvarieties of A g that are of the form where for 

some Shimura subdatum (G, X) one has X + a connected component of X, and 
r = G(Q)+ n T(N). Note that the center of G(M) acts on X trivially, and X+ is 
homogeneous under G a<i (IR) + . 

Typical cases of special subvarieties are given by moduli subschemes of A g that 
classify abelian varieties with PEL data. We refer the readers to [TH Section 
4, 5] and [HJ Section 8, 8.14, 8.15, 8.17, etc.] for more details. Following the 
notations in [TJ], the subdatum (G,X) C (GSp2 g , H g ) can be given as follows. 
Consider B a simple Q- algebra endowed with a positive anti-involution *, and 
{V,ip) a symplectic (B, *)-module. Let G be the linear Q-group of B-linear sym- 
plectic similitudes of V. The following moduli problem of tuple (A, s,i,i]k) is 
representable: 

(i) A is a complex abelian variety, with ±s a polarization of the Hodge structure 

tfi(AQ); 

(ii) i a homomorphism B — > End(A) <S)q A/, t] : V ®q Aj ~ H l (A, Q) <8)q A f 
a B ®q A/-linear isomorphism sending ip to an A^-multiple of s, and rjx is a 
X-orbit of rj, K being some compact open subgroup of G(Af), which is assumed 
to be sufficiently small so as to preserve a level iV structure on Hi(A, Q); 

(iii) there exists a i?-linear isomorphism a : Hi(A,Q) — > V sending s to a Q x - 
multiple of ip. 
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The moduli problem is represented by a Shimura variety Shx(G, X), with its 
canonical map into A g . 

In order to obtain special subvarieties of unitary type, one may take B to be a 
central simple i?-algebra, with E some CM extension of a totally real number 
field F, such that the restriction of * to E gives the complex conjugation fixing 
F . In particular, if one takes V = B as a Q-vector space, with ip given by some 
some element q G B x such that ip(x,y) = tr B /q(xqy*) (e.g. q is in E such that 
c(q) = —q). Then G der is a Q-form of ResF/QSL m , with m = y/dim E B, and 
G(M) is a product of unitary groups, whose signatures depend on the signatures 
of q along different embeddings F — > M. In order to make X + an Hermitian 
symmetric space associated to SU{m — 1, 1), one should choose the data in such 
a way that G(M) is the product of a unitary group of signature (m — 1, 1) with 
other unitary groups of signature (m, 0). 

In P 10.2] a Shimura subdatum (GSpin(V),X) C (GSp(C + (V), H(C + (V))) of 
orthogonal type is constructed. Note that the special subvarieties obtained from 
this subdatum are of the form with X + the Hermitian symmetric domain 

associated to SO(n — 2, 2)r ~ (GSpin(V))^. This reformulates the results in 
[5j Section 4, 5], which is inspired by [13J, where Kuga and Satake constructed 
a morphism from the moduli variety of K3 surfaces to the Siegel moduli variety 
of abelian varieties (for n = 21). Deligne's construction in [5] exactly fits into 
the formalism of Shimura data axiomized later in [Bj, except that it follows the 
traditional convention of signs for Hodge types. 

On the special subvariety defined by (GSpin(V),X) C (GSp(C + (V)), H(C + (V))) 
there exists a polarized Q-VHS of type {(-2,0), (-1, -1), (0, -2)}, with Hodge 
numbers h~ 2,0 = h 0, ~ 2 = = n — 2. Recall that in [51 4,5], from the 

Shimura datum (SO(V) ~ SO(n — 2,2), D) and the natural representation of 
p : SO(V) — > GL(V), one gets, for any x G D, a polarized Q-HS (V, p o x) of 
type {(-1,1), (0,0), (1,-1)} with Hodge numbers fr 1 ' 1 = h 1 " 1 = l,h°>° = n-2. 
Note that in p o x : § — > GL(Vu), the real multiplicative group G m C S acts 
trivially. Now lift p to the natural representation p' : GSpiniV) —> GL(V). Since 
the center of GSpiniV) conincides with that of GL(V) and that GSpiniV) is the 
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central extension of SO(V) by G m , we deduce that for any iGl with respect to 
the Shimura datum (GSpin(V),X), (V, p' ox) is a polarized Q-HS with types and 
Hodge numbers prescribed as in the beginning of the paragraph, namely shifted 
from the ones in [5] by (—1,-1). Consequently, from p' one obtains a polarized 
Q-VHS on the special subvariety defined by (GSpin(V),X), with the same Hodge 
numbers as (V, p' o x), Wx G X. 

Interested readers may also consider more general cases of indefinite quadratic 
spaces over a totally real number field, as studied in [12]. 

Let us explain some notation used in the statement of the following two theorems 
even if more details can be found in the subsequent sections. In this paper, the 
symbol Sz always denotes the divisor at infinity for any compactified subvariety 
Z C A g , i.e., the intersection Sz = Z PI S where S = dA g is the boundary of A g , 
whereas the "open" part Z\Sz is denoted by Z°. In all considerations and proofs 
in this paper we will always make the following general assumption: All divisors 
Sz = Z fl S which arise from intersections of images of subvarieties Z C A g with 

5 = dA g are divisors with normal crossings, i.e., the intersections are transverse. 
In particular we can speak about logarithmic differential forms on Z with poles in 
Sz- Many of our results may hold with weaker assumptions. However, we want 
to work out the principles here, and do not strive for maximal generality. 

Let Y C A g be a smooth subvariety and W C Y a subvariety of Y satisfying the 
above transversality as assumptions. We denote by 

N w /y = T Y {- log S Y )/T W (- log S w ) 

the logarithmic normal bundle of W in Y. Let p be the Picard number of Y and 
S the number of crossings of S fl Y. Let i : M° c — > A g be a special subvariety for 
the orthogonal group SO(2,n), where i is the so-called Kuga-Satake embedding 
[13] , and such that its toroidal compactification M also is embedded into A g . On 
M° there is a natural polarized VHS V of weight two and rank n + 2 coming from 
the standard representation of 50(2, n) in GL(n + 2). There is a natural proper 
inclusion V C i*Y® 2 as a polarized sub VHS which is explained for example in 
[S]. The local monodromy of V around Sm is assumed to be unipotent as well. 
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The (canonical) Deligne extension V' of V := V © Om° to M carries a natural 
Hodge filtration, i.e., a descending filtration 

V = F° D F 1 D • • • 

by subvector bundles and a logarithmic Gauss-Manin connection V : V — > V ® 
VL l M (\og Sm) extending V : V — > V ® O]^. The graded object associated to 
this filtration together with the graded logarithmic Gauss-Manin connection $ is 
the corresponding logarithmic Higgs bundle (E = E 2,0 © E 1,1 © E 0,2 ,i9) under 
the Simpson correspondence Main Theorem]. Note that only for VHS this 
correspondence is so simple. Griffiths' transversality for V' translates into the 
fact that $ is given by maps 

^2,0 . £2,0 _^ £1,1 ^ ^( logS ' M ) ) 01,1 . £1,1 £0,2 n l M (l 0g S M } 

and $ ' 2 = 0. Integrability of V implies $ A $ = 0. 

(2) 

The Griffiths- Yukawa coupling {r z on a smooth subvariety 2 : Z <^-> M intersect- 
ing S*m transversely in is defined as the composition 

0g) : = 01- 1 o tf 2 >° : t*E 2 ' — > z*^ 1 ' 1 © ft z (log Sz) — -» z*£ ' 2 © fi z (log S z f 2 . 

Note that -#( 2 ) lands in S 2 £l z (\og S z ) as the image in i*E ' 2 © f2|(logSz) is zero 
by the condition ■& A # = 0. 

In the following statements, the degree of a vector bundle F with respect to 
a line bundle L on a smooth projective variety F of dimension <i is defined as 
deg L (F) := ci(L) d_1 ci(F). The slope is defined as /j>l{F) : = deg L (F)/rank(F). 

Previous and new results. The Andre-Oort conjecture asserts that an irre- 
ducible subvariety Y° C A g is special if and only if it contains a dense set of CM 
points. Klingler and Yafaev [TO] have announced a proof of it using results of 
Ullmo and Yafaev and had to assume a generalized Riemann hypothesis. 
Our methods in this paper are not very sensitive to CM points versus non-CM 
points. However, the Andre-Oort conjecture would also imply that the closure of 
any union of positive dimensional special subvarieties is again special. 
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Our main goal therefore is to prove the following consequence of the Andre-Oort 
conjecture: Let Y° C A g be a subvariety containing sufficiently many special 
subvarieties of dimension > 1. Then Y° is special. 

The notion "sufficiently many" can be expressed for example in the following 
way. In [19] Thm. 4.4] we used special divisors W® C Y° satisfying Hirzebruch- 
Hofer proportionality (HHP) with i G /, a finite index set. Condition (HHP) is 
an equality condition arising from an inequality which in turn has its origin in 
natural stability conditions for Higgs bundles. We refer to [19] for the history of 
this condition. 

In [19] we then showed that Y° is special if (jJ exceeds some effective bound: 

Theorem (Thm. 4.4 in [H]). Let Y C M C A g be a subvariety of A g contained in 
a toroidal compactification M of a Shimura subvariety M° C A g of type SO (2, d) . 
We assume that Y and M intersect the boundary S of A g transversely, and require 
that fiy(log Sy) is nef and uy{Sy) is ample with respect to Y°. Assume dim(F) > 
2 and Wi G Y (i G / = finite set) are pairwise distinct divisors such that Wf C 
M° is special. 

(i) // all are of orthogonal type, if all Wi satisfy condition 



and if #1 > q(Y) := (p + 5) 2 + p + 5 + 1, then Y° C M° is a special 
subvariety of orthogonal type. 
(ii) Assume that the Griffiths- Yukawa coupling vanishes on Y. If the W® are 
special subvarieties of unitary type, if condition (HHP) holds 



and if j^l > <;{Y), then Y° C M° is a special subvariety of unitary type. 
(iii) Let Y be a surface and I = {1,2}. Assume that 



and deg Nwi/Y — for i = 1, 2. Then Y° is the product of two Shimura 
curves. 



(HHP) : 



deg^ ( s Wi )(^/y) _ deg„ w , (Sw . } (T Wi ( - log S Wi ) ) 
rankAVj/y rankT Wi (- log S Wt ) 



(HHP) : 



feguw^SwjjNwi/Y) _ deg^ (Swi ) (T w . ( - log S w . ) ) 

TSHlkN\Yi/Y d+1 



<Tl(Wi)n<T 2 (W 2 ) 7^0 
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In the following main result in this paper we remove the divisor hypothesis and 
obtain necessary and sufficient conditions supporting the Andre-Oort conjecture. 
We need some additional notation to explain the theorem: We say that Y can 
be covered by a smoothing of a cycle J2i a «C« °f compactified special curves 
(jo c y° satisfying (HHP), if there are finitely many embedded special curves 
Cf C Y° satisfying (HHP) such that their compactifications Cj C Y admit a 
linear combination J2i a iCi with integer coefficients which can be deformed as 
embedded cuves in Y in a family, such that the general deformation is smooth. 
Condition (HHP) in this case is given by equality in the following inequality: 

rank(7V~i ) + rank(M /v ) 
(HHP) degiV c/Y < C/Y> 2 — ^ • degT c (-lo gl S c ). 

Here Nq/ y is the Harder-Narasimhan filtration on the logarithmic normal bundle 
Nc/A g intersected with Nq/y- We also fix C\ and a base point yo G C\. With 
the notation for the Higgs bundle E on M restricted to Y we then define the 
following vector spaces: W yo€Y is the subspace of vectors in E^ 1 vanishing unter 
i? at the base point yo and W Vo& y,r C W yoe y the real subspace of real vectors in 

Theorem 3.6. Let Y C M C A g be a subvariety of A g contained in a toroidal 
compactification M of a Shimura subvariety M° C A g of type SO(2,n). We 
assume that Y and M intersect the boundary S of A g transversely, and that Y 
can be covered by a smoothing of a cycle J2i a i^i °f compactified special curves 
C° C Y° satisfying (HHP). Then: 

(a) IfW yoe Y = Wy ()( zY,R®C for some yo G C\ then Y° C M° is a special subvariety 
of orthogonal type. 

(b) If the Griffiths- Yukawa couplings along all Cj do not vanish then Y° C M° is 
a special subvariety of orthogonal type. 

(c) If the Griffiths-Yukawa coupling along Y vanishes then Y° C M° is a special 
subvariety of unitary type, i.e., a ball quotient. 
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In the assertions (a) and (b) of this theorem one may replace the assumption on 
the smoothing of the cycle ^ a-iCi of special curves C, C Y satisfying (HHP) by 
the following: Assume that there is a connected union C\\J - • -UC/ of compactified 
special curves satisfying (HHP) and such that the image TTi([JCf,*) under the 
natural map in 7ii(Y°, *) is big in the sense that the image of vr 1 (|JC , 4 , *) under 
the monodromy representation restricted to Y° 

MlJC*,*) ^ n^Y ,*) A SO(2,n) 

is Zariski dense in the algebraic monodromy group H(Y°), i.e., the Q-algebraic 
closure of the monodromy representation p. We note that this is a subgroup of 
Hermitian type in SO(2, ra). This is nicely explained, for example, in [T71 Sect. 
1.3]. Hermitian subgroups of SO(2,n) like H(Y°) can be classified. Besides the 
obvious orthogonal and unitary subgroups which are Q-simple there are SL2 x 
SL2 and quaternionic versions [211 Thm. 5.2.3.]. In the non-Q-simple cases we 
therefore have dim(Y) = 2 and Y° is uniformized by a product EI x H of upper 
half planes. 

Acknowledgements. This work naturally continues the results in [19]. To- 
gether with Eckart Viehweg we have thought about thickenings of Higgs bundles 
during a stay at Fudan University in the summer of 2007. Thickenings play an 
essential role in this paper which therefore should be considered as joint work 
with Eckart. 

We thank Ke Chen for explanations on Shimura data. We also thank Michael 
Harris for enlightening discussions about special cycles and the referee for several 
helpful remarks. 

1. Basic Setup 

In this section we will use the Simpson correspondence for curves [231 Main Thm.]. 
It is a natural equivalence between the category of direct sums of stable filtered 
regular Higgs bundles of degree zero and the category of direct sums of stable 
filtered local systems of degree zero. We will need this correspondence only in 
the case when the local system V has unipotent local monodromies. In that case 
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the filtration on the Higgs bundle is trivial and deg(V) is automatically zero. We 
refer the reader to [25| sect. 1] for additional results and explanations on Higgs 
bundles on curves building up on Simpson's work. 

Consider a non-singular projective curve C and a non-constant morphism 

if : C -> Y C A g , 

where Y C A g is a smooth projective subvariety as in the introduction. We set 
C° := y? -1 (y ) ^ 0, where Y° = Y n A g denotes the "open" part. 
In the following we consider the situation where C° is a Shimura curve and 
Sc '■= C \ C° is the set of cusps. We also denote by Sy the intersection of Y with 
S = dA g and we assume that the intersection is transversal such that Sy is a 
divisor with normal crossings. We assume that the restriction (p : C° — > Y° C A g 
is an etale morphism of Shimura varieties. Let / : X — > C° denote also the family 
obtained by pullback via (p. 

The main goal of this paper is to find new criteria when Y° itself is a special 
subvariety in A g , for example if "sufficently many" such curves C with certain 
properties map to Y. In such a situation, by [251 Prop. 1.4] and [TBI Thm. 0.9], 
after replacing C° by an etale cover, the local system Vc-o := y9*i? 1 /*Cx admits 
a decomposition 

V c o = L ® T © U 

as a polarized complex variation in the sense of Deligne, i.e., a polarized C-VHS 
in the sense of Simpson [23] on C°. Note that this etale cover of C° is necessary, 
however, all our proofs below are insensitive to such etale base change even if we 
apply this construction to a finite number of curves simultaneously later. Here L 
is of weight one and rank two with the logarithmic Higgs bundle 

(C © ZT 1 , r : C ~ C- 1 © ^(log Sc)) , 

T is concentrated in bidegree (0, 0) and self dual, whereas U is of weight one and 
decomposes in two local subsystems 

U = U 1 ' © U - 1 , U 1 ' = U°' lv . 
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Note that the local systems T, U 1 ' and U ' 1 are unitary and the local mon- 
odromies around Sc are unipotent, hence the local monodromies are in fact triv- 
ial. Hence T, U 1,0 and U 0,1 can be extended as local systems to C. Writing 
(T = T <g> O c , 0) and (U = U 1 ' g> O c , 0) © (W v = U ' 1 <g) O c , 0) for the corre- 
sponding Higgs bundles, then the Higgs bundle corresponding to Y c o decomposes 
in the form 

(1.1) (E 1>0 © E ' 1 , 0) = (£ © C-\ r) © (T, 0) © (W, 0) © (W v , 0). 

The line bundle C has positive degree, since C is the pullback of some positive 
power of the automorphic line bundle on A g via ip : C — > A g . Since <p : C° — > A g 
is not constant and the automorphic line bundle is positive on A g it follows that 
deg(£) is positive. Via the isomorphism r we identify Tc(— log Sc) = • 
The Hodge metric V^o comes from the tensor product of the Hodge metrics on 
L, T, U '° and U ' 1 , which, by [2U Sect. 4] and [23], coincide with the Hermitian- 
Yang-Mills metrics on the corresponding logarithmic Higgs bundles. The Hodge 
metrics on E l, ° and E ' 1 are tensor products of the Hodge metrics on T, U 1,0 
and U ' 1 . 

In general, a Hodge bundle with Hodge metric of any Schur functor S(Yc°) is 
obtained in a similar way from the Hodge metrics on C^, T, U 1 ' and U 0,1 . 

Let / : X -> A g denote the universal family, V := R l fXx and E := E 1 ' © E ' 1 
the logarithmic Higgs bundle corresponding to Deligne's canonical extension of 
V©(9 J 4 s on the toroidal compactification A g D A g . It comes with the logarithmic 
Higgs map 

Since V is a polarized VHS, there is a natural isomorphism End(E') ^ i?* 82 . Then 
it is well-known [7, p. 339] that the composition 

T-j g (-\ogS) A End(E) 4 E m -> S 2 ^ ' 1 ), 
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identifies Tj g (—\ogS) with S 2 ^ ' 1 ). The derivatives of the maps 
induce the following commutative diagramm 

dip 

(1.2) -> T c (- log S c ) y?*T y (- log S Y ) N c/Y , 

p p 

T c (- log S c ) (i o v)* t a 9 (- log Sy) N c/Xg -> 

where Nq/y is the (logarithmic) normal bundle of <p : C — > Y and N c ^ g is the 
(logarithmic) normal bundle of % o tp : C — > A g . 
On the curve C one has 

(io^yTj g (-\ogS) = (lo^ys 2 ^ 1 ) = (c~ 2 ®s 2 {T))®(c- l ®r®U")®s 2 {u w ), 

where the decomposition on the right side is induced by (11. ip and is orthogonal 
with respect to the Hodge metric. 

All three summands are polystable by the main theorem in [23], but, as deg(£) > 
0, with different slopes 

—2 deg £, — deg £ and 0. 

Consider the inclusion 

T c (-\ogS c )^ip*Ty(-\ogSy) 4 (io<p)*Tz g (-\ogS) = 

= (£- 2 © S 2 (T)) © (C~ l © T © U v ) © 5 2 (W V ), 

As the derivative dip can be identified with the Higgs map 9 and 9 on C preserves 
the direct sum decomposition in (II. ip and vanishes on the second summand, the 
image of T c (— log Sc) is contained in C~ 2 © S 2 {T). 
For the convenience of the reader we recall the following definition. 

Definition 1.1. A holomorphic subbundle i : F > E of a Hodge bundle of a 
polarized complex variation of Hodge structure is called a direct summand of E 
and orthogonal with respect to the Hodge metric if there exists an isomorphism 
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E ~ F © G between holomorphic vector bundles, such that the first summand 
defines the inclusion i and the decomposition is orthogonal with respect to the 
Hodge metric. 

Lemma 1.2. The line subbundle 

T c (-\ogSc)dC- 2 ®S 2 (T) 

induces a holomorphic decomposition of Cr 2 © S 2 {T), which is orthogonal with 
respect the Hodge metric, i.e., there exists a holomorphic subbundle 

T c {-\ogS c ) L ^C- 2 ®S 2 {T) 

such that 

C- 2 ® S 2 (T) = T c (- log S c ) © T c (- log Sc^, 
and such that this decomposition is orthogonal with respect to the Hodge metric. 

Proof. We note first that the Hodge metric on Cr 2 © S 2 (T) comes from the 
corresponding tensor product of the Hodge metrics on the polarized C— VHS 
L, T and U. The Hodge metric on the corresponding Higgs bundle T is the 
Hermitian-Yang-Mills metric by [23]. Consider the subbundle 

T c (-logS c ) aC- 2 ®S 2 (T). 

Since 

t : C~ C- 1 ®Q} c (\ogS c ), 
we have Tq{— log Sc) = £~ 2 , hence 

c -m c C - 2 ®S 2 (T). 
Dividing both sides by the factor C~® 2 we get 

O c C S 2 (T). 

Note that the Higgs bundle S 2 {T) has zero Higgs field. Hence Oc is a Higgs sub 
bundle of S 2 {T) with slope equality yu(Cc) = = fj,(S 2 (T))- Applying Simpson's 
Higgs polystability, there exists a holomorphic decomposition 

S 2 (T) = O c ®O c , 



13 



which is orthogonal w.r.t. the Hermitian- Yang-Mills metric on S 2 (T). Tensor- 
ing with C~® 2 on both sides of the above decomposition, we obtain the desired 
decomposition as claimed. □ 

The decomposition in Lemma 11.21 induces the following decompostion 

(io^rr^t-iogsy) = t c (- log Sc)@(t c (- log Sc^ © (c- 1 © r©w v ) © s 2 (u v )) 

Let p denote the projection to the first summand, then the composition 



T c (-lDgSc)%<p*T Y (-logS Y ) ^ {io V yT Ag (-logS)^T c (-logSc) 

is the identity. This shows that both horizontal short exact sequences in diagram 
fll.2p split in the form 



iii 



;i.3) 



such that 



^Tyi-logSy) 



di 



{ioipYTr (-log Sy) 



T c {-\ogS c )®N c/Y 



T c (-\ogS c )®N c/lia 



N, 



C/A a 



t c {- log Sc) 1 - © (c- 1 © r © U v ) © S 2 (U V " 



Remark 1.3. The holomorphic and orthogonal splitting 

Tc(-logS) (iocpyT^i-logS) 

for a special curve i o ip : C° — > A g in (11.31) holds also true in general if C° is 
replaced by any special subvariety, see the proof for ii) in Proposition 11.51 In 
diagram (11.31) we obtain an explicit description of the logarithmic normal bundle 



N, 



C/A a - 



We shall now describe the Harder-Narasimhan filtration on N c ^ . Let 



N° - 



N 1 - 

C/A g 



T C (-]ogScr, 

t g {- log Sc)^ © /r 1 © r © w v 
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and 



N l/A g ■= N C/A 3 - 



Then the filtration 



C N« c/ - Ag C Nl- Ag C ^_ = Nc/ - Ag 

is the Harder-Narasimhan filtration on N c ^ g - In our situation, the graded sum- 
mands 

NI c,aJ N c% for0<,<2 
are polystable vector bundles of slopes degT c (— log Sc), \ degT c (— log Sq) , and 
0. One has 

TV 1 - = N° - ffi N 1 - /N° - 

^C/Ag ^C/Ag^^C/Ag/^C/Agl 

N l,A a = Nl crA® N2 crAj Nl crA 9 - 

Taking the induced filtration on N c /y C ^c/A g obtained by intersection with 

TV* - 

C/A g 

C N° c/Y C N l c/Y C N 2 C/Y = N c/Y , 

one finds subbundles 

N$ Y /Nh /Y C N^jN* c/A - g . 
We arrive at the following definition: 

Definition 1.4. ip : C — >■ Y satisfies relative Hirzebruch-Hofer proportionality 
(HHP) if the slope inequalities 

rtNffy/Nhjy) < KN z c %jN^ g ), i = 0, 1, 2 

are equalities. One has 

^ n2 c,aJ N c/a) = M^W) = °> 

l*( N h/Z a /^pO=l'( £rl ®T®U v ) = idegT c (-log5 c ), 
M^S/z.) = /x(Tc(- log Sc)- 1 ) = degT c (-logS c ). 
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Hence, we obtain a set of inequalities 

Li{N 2 c/Y /N l c/Y ) < 0, 

1 



KNo/y/No/y) < ^degTd-hgS, 



c 



M/y) < degT c (- log S c ). 

Using jj, = and adding all three inequalities we obtain a single inequality 

rank(M ) + rank(iV° lv ) 
(1.4) degiV c/y < C/Y> - ■ degT c (-log5 c ). 

It satisfies equality if and only if (HHP) holds. 

These conditions are called (HHP) since Hirzebruch [8], in part with Hofer [3], 
has studied embedded curves on ball quotients and Hilbert modular surfaces and 
studied proportionality inequalities involving intersection numbers that attain 
equality if and only if the curve is the compactification of a Shimura curve. 
Hirzebruch's inequalities together with our proof of them can also be found in 
[321 Thm. 0.1]. 

Proposition 1.5. 

(i) If (f : C — )■ Y satisfies (HHP), then ip*Ty(— log Sy) is a direct summand of 
an orthogonal decomposition of <p*Tj (— logS 1 ) with respect to the Hodge metric. 

(ii) IfY° C Ag is a special subvariety, then ip*Ty(— log Sy) is a direct summand 
of an orthogonal decomposition ofip*Tj(— log 5) with respect to the Hodge metric 
and (p : C — >■ Y satisfies (HHP). 

Proof, (i) Assuming (HHP), the slope of the sub bundle 

N h y Y /N h/Y C N^/N^ g 
is equal to the slope of iVl+1 IN',-, . Since iVl+I lW nj - A is polystable, N^L/Nl.y 

C/Ag C/Ag C / Ag C / Ag O / I O / I 

is a direct summand of an orthogonal decomposition of N l t,K /N % nrE w.r.t the 

C/Ag C / Ag 

Hermitian-Yang-Mills metric, which is the induced Hodge metric on iV*+i- IN 1 .-^ . 

C/Ag C/Ag 

Claim: The sub bundle N l c j Y C N l G ^ , < i < 2 is a direct summand and 
orthogonal. 
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Proof of the claim. For i — 0. Since 

N° C/ yK} y = N° c/Y , N» crA jN-y Ag = N° /Ag , 
we have shown above 

N c/y c n °c,a 9 

is a direct summand and of an orthogonal decomposition of N%.-j w.r.t.the Hodge 

metric. Let p : — > N^ Y denote the projection. 

For % — 1, we consider the following commutative diagramm 



— ► iV° /y , N* c/Y , N* c/Y /N° /Y — ► 



— )• A r ° - 



N 1 - 

C/A g 



N° - 

C/A g 



(P,0) 



jV° _ 



C/Ag I C/Ag 



N 1 - 

C/Ag 



Since the composition map 



N c /y -> Nh IY ^ A iV° /y 

is the identity, the short exact sequence 

iV° /y -> A£ /y iV* /y /iV° /y -> 

splits, and 

^/y = ^c/y © Nl /Y /N° c/Y C ^ © N^/N"^ = N^. 

Since Af£y y C and N^ Y /N^ Y C ATiy^ /N^ A are direct summands and 

orthogonal, ^V^ y C is a direct summand and orthogonal. 

Finally, replacing iV° by A^/iV , iV 1 by iV 2 and N 1 /^ by A^/iV 1 in the above 
diagramm, we obtain N c /y C ^c/A g * s a direct summand and orthogonal. The 
claim is thus proven. 
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We are now in the position to finish i). Since by diagram ( 11. 3ft 

<p*T Y (- log S Y ) =T c {- log S c )®Nc/Y C Tc{-\ogS c )®N c/ A g = (io^T^-logS), 

and by the above claim Nq/y C ^c/~A a ls a direct summand and orthogonal, 

^T y (-log5y) C (io^T^-logS) 
The proof of i) is thus complete. 

(ii) Let i : F° H> i4 9 be a special subvariety. Then V is a locally symmetric 
subvariety of the locally symmetric varity A g and the vector subbundle di : Tyo c — >■ 
i*T^ g is a locally homogenous subbundle of the locally homogenous bundle i*Ta 9 
in the sense of Mumford [201 Sect. 3]. As a locally homogenous bundle can be 
decomposed as direct sum of irreducible locally homogenous subbundles and this 
decomposition is orthogonal w.r.t. the invariant metric, di : T Y o e — >■ i*T& is a 
direct summand and orthogonal. Note that the Deligne extension of the sheaf of 
differential 1-forms is the sheaf of differential 1-forms with logarithmic poles at 
infinity. By the uniqueness of Deligne 's extension we get that di : Ty (— log Sy) 
i*Tj (— log S) is a direct summand and orthogonal. Thus, 

di : ip*T Y (-\ogSy) C (i o ip)*Tj g (- log S) 

is a direct summand and orthogonal. (The argument here was pointed out by the 
referee.) 

Since ip : C° — > A g is a morphism of Shimura varieties, one has the decomposition 

(i o ^)*T Zg (-io g s) ~ s^e ' 1 ) = c- 2 <8> S 2 (T) © /r 1 ® r ®W V © S 2 (U V ) 

of polystable subbundles which can be decomposed further as the direct sum of 
irreducible stable subbundles. 

{io<p)*T 7[g {-logS)=K 1 ®---®K l . 

By a theorem of Atiyah [2] the category of vector bundles over any compact com- 
plex manifold is Krull-Schmidt, i.e., in our case if there is a second decomposition 

{io^yT-A g {-logS) = K[®---®K' v 
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of irreducible subbundles, then up to a permutation one has 

Ki ~ K' v . 

This shows that {% o (p)*Ty(— log Sy) is the direct sum of some direct factors of 
£~ 2 ®S 2 (T), £ _1 ©T ©W v and S 2 (U y ) and therefore the relative proportionality 
inequality ( J1.4|) is an equality □ 

In the proof of Proposition 1.5 we see that the inclusion 

<p*Ty(-l0gSy) C (io^)*T 3a (- togS) 

is compatible with the decompositions 

<f*Ty(- log Sy) = T C (- log S C ) © N c/ y = T C (- log S C )® 0j =Q ^/^y 

X" i I >r II "X 

(io V> )T a> (-log5)= T c (-logS c )©iV c/ ^= T c (-logS c )© ^lo^jN^. 

Example 1.6. If Y is a Shimura surface, then Nc/y is a line bundle and there 
are three cases in which we write (HHP) in terms of more familiar intersection 
numbers, see [3] and [02 Thm. 0.1]: 

(i) Y is a Hilbert modular surface: 

N c /y = N c/y c£- 2 ®S 2 (T)/£- 2 , (HHP): uj y (S) ■ C + 2C 2 = 0. 

(ii) Y is a Picard modular surface: 

N c/Y = N c/Y /N c/Y C C- 1 (8) T © W v , (HHP) : co Y (S) ■ C + 3C 2 = 0. 

(iii) K is product of two Shimura curves: 

Nc/Y = N 2 c/Y /N c/Y cS 2 (U y ), (HHP): C 2 = 0, 
and C lies in the fibres of one of the projections. 

Question 1.7. Does the (HHP) for a single compactified Shimura curve C to- 
gether with ip : C — > Y C A g as above imply that Y° C A 9 is a special subvariety, 
if we assume that the algebraic monodromy group H(Y°) (see introduction) is 
Q-simple ? 
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This question seems to be very optimistic and at the same time difficult to an- 
swer. However, we are not aware of any counterexamples if H(Y°) is Q-simple. 

It is our goal in the rest of the paper to show that the existence of "many" 
special curves, e.g. a dense subset of such satisfying (HHP) forces Y° to be a 
special subvariety. 

Remark 1.8. Consider the same situation ip : C — > Y C A g , where Y° C A g is a 
special subvariety and C an arbitrary curve, not necessarily Shimura. Then one 
obtains an inequality opposite to (jl.3p . see for example [19j Thm. 0.3 and Thm. 
2.3]. 

2. Thickening of the Higgs field 

We use the same notation as in the previous section. In particular C is a com- 
pactified Shimura curve together with a non-constant morphism ip : C — > Y C A g 
factoring over a smooth projective subvariety Y such that S = dA g intersects Y 
and the image of C transversely. In the previous section we showed that under 
these assumptions there is a canonical splitting 

see (11.31) . Also we denote by E = E 1,0 © E ' 1 the (logarithmic) Higgs bundle on 
A g associated to the local system Vc = i? 1 /*C, where / : X — > A g is the universal 
family over A g . Its restriction to Y or C will be denoted by the same symbol. 
We also make use of the complex vector bundle V := V <S> Oa 3 or its restrictions 
to Y° and C°. The following definition is new in the literature and goes back to 
our discussions with Viehweg. It enables us to include the normal direction to C 
in Y into our considerations. 

Definition 2.1. We define the thickening of the Higgs field 9 on C in the normal 
direction Nc/y as the pullback of the Higgs bundle on Y via <p : C — > Y: 

9 C/Y := cp*e : E 1,0 E 0,1 ® cp*n y {logS Y ) = E 0,1 ® (SllQogSc) © N% /Y ). 
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In the same way we define the thickening of the Higgs field in a point p G C in 
the normal direction N p /y as 

P/Y := 0c/y\ p : E lfi \ p -> £; ' 1 | p ^*^(log ( S'y)| p = E^l^^og S C )\ P ®N^ /Y \ P ). 

Consider the fc-fold tensor product (E, 0)® k of the Higgs bundle (E, 6) on Y . It 
decomposes CIS db direct sum 

E ®k = E p,q 
p+g=k 

where 

E P,9 = E Pi,1x . . . (g, 

and where the sum ranges over ^ + g» = 1, 5^i=iPi = Pi Y^i=i Qi = Q- The Higgs 
field, again denoted by 9, decomposes as 

6 : E p ' q ® ft y (logS y ), 

where 

® • • • ® £ pt * £ Pl ' 91 <8) ■ • • ® ® • - - ® E Pk ' Qk ® fi y (log SV) 

8=1 

satisfies the Leibniz rule 

6l£pi><ji®...(g)£Pfc><?fc = /J id <g> ■ ■ ■ <g> liO (g> ■ • ■ (g> id. 

i=l 

In the same way as in the definition above we define the thickening (E,8c/Y)® h 
and (E, 6 p/Y )® k . 

Assume for a moment that Y° is a locally symmetric quotient of a bounded 
symmetric domain. Then it is well-known that f2 y o, and all Hodge bundles Eyl 
are locally homogeneous vector bundles in the sense of Mumford [201 Sect. 3]. 
Furthermore, the Higgs map 9 p,q : Eyo ~^ E p ~ 1,,!+1 \yo (g> f2 y0 is an equivariant 
morphism between locally homogeneous vector bundles. We decompose Eyo as 
the direct sum of irreducible locally homogeneous subbundles 

TPP'i — £D F p ' q 
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Then we take Mumford's canonical extensions Ey\ [201 Sect. 3], which agrees with 
Deligne's extension by [T5J Lemma 2.4] of those irreducible locally homogeneous 
subbundles, and we use the same symbols 

i 

for the extended decomposition by uniqueness of good extensions. Complex con- 
jugation 

V c -4 V c 

induces also a complex conjugation on the Deligne extensions of V|c° = V® 0c° 

and sends E™ to Ep p (~ E™ v ), hence E™ to (~ ££;f ). 

Given a base point y G F (y could lie on the boundary Sy) we consider 

eii Y : ^ e%~ 1,p+1 ® ^Qogsv),, 

where E^' p carries the induced real structure from V® k . Its real structure is 
induced from Vjr = Vq <g> R. 

Definition 2.2. Let y G K be a base point: 

(a) jy ye y := {teE^\6 yeY (t) = 0}. 

(b) A tensor t G .E P,P D Vjf 1 ^ is called a rea/ Hodge tensor at the base point y G F. 

(c) ^ ey , R := {t g £. p ' p n v|* | e yeY (t) = o}. 

Remark 2.3. It is clear that W y€ Y,m. ® C C W y€ y, but in general they are not 
equal. 

Proposition 2.4 (Parallel Transport). There exists a unitary subsystem W C 
Y®fc j p Ure Hodge type (p,p), which naturally extends to Y , carries an induced 
real structure from N® k and such that Wr^ = W y£ y,R for all y G Y . 

Proof. From the above discussion we know that Ep p decomposes as direct sum 
of good extensions of irreducible locally homogeneous subbundles 

E P y P = @E™. 



22 STEFAN MULLER-STACH AND KANG ZUO 

Since 9 P ' P : E p ' p — > E p ~ 1 ' p+1 (g)f2y(log Sy) is a morphism between good extensions 
of locally homogeneous vector bundles, ker(9 p ' p ) is again a direct sum of good 
extensions of locally homogeneous subvector bundles, which are Higgs subbundles 
(with trivial Higgs field) of (E, 9)® k . By Simpson's polystability all of them have 
non-positive slopes. We decompose (as holomorphic vector bundles) 

ker(^' p ) = ker(^' p ) © ker(9 p ' p ) <0 , 

where ker(6 lp,p )o is the direct sum of good extensions of locally homogenous sub- 
vector bundles of slope zero and ker(# p ' p )<o is the direct sum of good extensions 
of locally homogeneous subvector bundles of negative slopes. By Simpson's corre- 
spondence ker(9 p ' p ) underlies a unitary local subsystem W C Y® k of type (p, p). 
ker(9 p ' p ) is invariant under complex conjugation induced by the real structure on 
V® fc . This can be seen as follows: the complex conjugate ker(9 p ' p ) corresponds to 
the complex conjugate W of W, which is again a unitary sublocal system of type 
(p,p). Hence it vanishes under the Higgs field 9 P,P , i.e., ker(# p > p )o C ker(9 p,p ). Note 
that ker(# p ' p )o is again the direct sum of some good extensions of locally homo- 
geneuos subvector bundles of slope zero, hence we obtain ker(# p ' p )o C ker(9 p ' p ) . 
Clearly for all real vector t e ker(9 p ' p ) 0ty we have 9 p > p (t) = 0, so t e W yeY ,R- Con- 
versely, let t G W yGY ,R- Then t is a real vector in ker(9 p ' p ) y . There are no vectors 
in ker(9 p ' p ) < o ) y fixed by complex conjugation, because complex conjugation takes 
negative slopes to positive slopes. Therefore t is a real vector in ker(# p ' p ) 0ir Thus 
we have shown 

W RiJ , = W yeY ,R. 

Since V (X,fc has unipotent local monodromies around Sy and W is unitary, the 
local monodromies of W are trivial around Sy- Hence W extends across Sy. □ 

Remark 2.5. For a rational Hodge tensor t G W y< zy, t is contained in a unitary 
local subsystem with a Z— structure. Hence the orbit 

{p( 7 )(t)|7evr 1 (F , 2/ )} 

is finite. 
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For a Shimura curve C° mapping to A g via tp as above we can describe the above 
decomposition more precisely. For the Higgs bundle E one has from section 1 

E 1 ' = £©T©W, E ' 1 = Cr x © T© W v , 

where £ © T and £ _1 © T are polystable of slopes deg C and — deg £ respectively. 
Moreover if U ^ then U and U y are both polystable of slope zero. So one obtains 
immediately: 

Lemma 2.6. The sheaves E p,q are direct sums of polystable sheaves E p,q of slopes 
fi(E p ' q ) = tdegC and one has: 

(a) If U = 0, then E p ' q ^ if and only if l = p - q, and E p > q = E?> q . 

(b) IfU^O, then E p,q ^ if and only if i £ {— q, . . . ,p}. In this case E p,q is a 
direct sum of sheaves of the form 

(£ © rf m © (c- 1 © r)®' © w^ (p - m) © u v ®( q - l \ 

m—l=L 

(c) The sheaf Ef* zs duaZ to £ p f. 
Consider the decomposition (11. 3p 

<^T y (-log£ y ) = iV c/y © Ib(-log^a). 

The assumption that tp : C — > K satisfies (HHP) implies the decomposition in 
the proof of Proposition 1.2 

iV^/y = A£ /y © N l C/Y /N° C/ y © N^/y/N^y 

such that 

Nq/y C = £" 2 g) S 2 {T)/C~ 2 C Hom(£ © T, ZT 1 © T)//r 2 , 

^c/y/^c/y C N x c/lig /N c/lig = L~ x © T © W = Hom(C © T, U y ) 

and 

n c/y/ n c/y C N*/N' = S\W) C Uom{UM y ) 
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are direct polystable factors of slopes —2 cleg £, respectively — cleg £, respectively 
0. In this way we may decompose the thickening 9q/y in the form 

c /y = C + e Nc/Y =6 C + 9 n o /y + n i c/y/n o /y + N 2 c/y/n i c/y . 

Using that decomposition we obtain: 

Lemma 2.7. The thickening 9c/y on E V L A can be decomposed as a direct sum of 
morphisms: 

8c+e N o 

K q ^ BCl** 1 ® (nJ;(log5o) © N° C J Y ), 

/N° 



and 



N 2 f N l 

Ey C/Y c/y ) ® (N* /Y /Nh /Y y. 



between polystable sheaves of the same slopes. 
Proof. Write 

E lfi = C®T ®U, E ' 1 = CT 1 ®T®U V , 
then 9c/y '■ E 1 ' — > E ' 1 ® (p*Q Y (\og Sy) decomposes into the following terms: 

c <g) r ^> /r 1 ® r ® ^(iog 5 C ), 



and 



£ ® r C/Y CiY ) u y ® (N l c/Y /N Q C/Y y 



V N 2 i N l 

u C/Y C/Y i u-®(N> C/Y /Ni /Y y. 



This proves the lemma for the case k — 1. In general, one reduces the cases k > 2 
to the case = 1 using the fact that the thickening 9®* Y is defined by the Leibniz 
rule. □ 
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3. Parallel transport of real Hodge tensors on connected 

cycles of special curves 

In this section let Y C A g be a smooth projective subvariety, which meets S = 
dA g transversely. Assume Y contains a connected cycle £\ Cj of finitely many 
compactified embedded special curves, such that each component Cj meets Sy = 
S C\Y transversely and satisfies (HHP). Using base points jji G Cf and notations 
from the previous section we introduce the following subspaces: 

Wy i& := {t G E*f | Oy i& {t) = 0}, 

n 

W yieCi := {tG^|fl weCl (t) = 0} 

and the real spaces 

WW := i^ei^nvru W*) = o}, 
n 

WW** := {t€E2*nvg k \ vt \e VieOl (t) = 0}. 

Fixing a base point y\ G C° we now need to study the parallel transport of real 
vectors in W yi£ y,R along paths in the connected subspace [j { C*. 

Proposition 3.1. (a) The real subspace W Vi€ y,m. C Vjf fc is invariant under the 
monodromy action p® k {'Jti([J i 

(b ) Assume that E^f is polystable of slope zero for all Ci . Then W yie y is invariant 
under the monodromy action p® k ('n'i([J i Cf, yij). 

Proof, (a) We have the decomposition 
Hence, 

W yieY>R = { t g W yie c u R I 9n Ci / Y ,vi = }• 

By Proposition 12.41 there exists a unitary subsystem C Vjf k of Hodge type 
(p,p) such that W yieC i,M = Wcf 1)Vl . 
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Let Wd C E^f denote the polystable subbundle of slope zero corresponding to 
Wei • Then by Lemma 12.71 

°n Ci/y ■■ w Cl ^o Nci/Y (w Cl ) 

is a morphism between polystable bundles of slope zero. Hence the kernel 
ker(6 Nci/Y : W Cl -> ^(Wft)) =: 

is a polystable subbundle of Wa of slope zero. Therefore it underlies a unitary 
subsystem W c C Wd ® C. From the construction of W' Ci we see that 

W yieY ,RCW' Cuyi . 

We start with a real vector G W yie Y,u and denote by i 2 the parallel transport of 
t\ as a vector in the fibre of the local system Vf ^ along some path in C° from t/! 
to y 2 G c?nc§. Since ti is contained in the fibre of the subsystem C 
at yi, t 2 is a real vector (because of the real structure on V® fc ) and contained in 
the fibre of W' c at y 2 . By the construction of , we see that O y2 /c 1 {t 2 ) = 
and 9 Nci/Yt y 2 (t 2 ) = 0, i.e., t 2 G W w6 y lR . 

Regarding y 2 G C 2 we re P ea t the above argument and continue the parallel 
transport of t 2 along some path in C 2 from y 2 to y$ G C 2 fl C3 etc.. This shows 
that W yi& Y,R C Vf^ is invariant under the monodromy action p® fe (7ri(lJi Cf, yi))- 
(b) Since is polystable of slope zero, ker(9(?) is a Higgs subbundle of slope 
zero (with trivial Higgs field) and it corresponds to an (extended) unitary local 
system C V®^ with an induced real structure, and such that Wq^ = W ye ci 
for all y G C\. Since W yi£ Y = {t G W yie c! \Qn c /y,yi(t) = 0}> by the same 
argument as in (a) we find a unitary subsystem W' Cl C Wd such that y = 
W y( zY for all y E C\. The rest of the proof is exactly the same as in (a). □ 

Definition 3.2. We say that Y° can be covered by a smoothing of a cycle £\ a^Cj 
of special curves Cj satisfying (HHP), if there is a suitable linear combination 
Y2i O'iCi of compactified special curves Cj C Y satisfying (HHP) which can be 
deformed into a generically smooth family of curves U z( zzC z filling out Y, i.e., 



27 

such that Yli a iCi is a degenerate fibre of a generically smooth family of curves 
^zezCz over some parameter scheme Z. 

Proposition 3.3. Assume that the algebraic monodromy group H(Y°) ofY° (de- 
fined in the introduction) is Q-simple and that Y° can be covered by a smoothing 
of a cycle ^2 li a i C i of special curves Ci satisfying (HHP). We fix a base point 

yo e CI 

(a) ThenWy^uCY®^ is p m {'K 1 {Y G >,y )) -invariant. 

(b) Under the assumption in Prop. GO (b), W yoeY C Y^ k is p® fc (7Ti(Y , y ))- 
invariant. 

The following Lemma is Proposition 2.2.2 in [26J. It will be used below. 

Lemma 3.4. Let X be a smooth complex quasi-projective variety, k a field of 
characteristic 0, G an almost simple k-algebraic group and 

p : 7Ti(X,*) ->> G(k) 

be a Zariski dense representation. Then the following holds: 

(1) If tt : X' X is a surjective and generically finite morphism, and X' is 
smooth, then 7r*(p) is again Zariski dense. 

(2) If f : X Y is a surjective morphism to a smooth quasi-projective variety 
Y with connected fibres, and if f~ 1 (y) C X is a smooth fibre, then there are two 
possibilities: 

either 

(i) the restriction p\f-i( y ) is again Zariski dense, or 

(ii) p\f-u y ) has finite image. 

Proof. (Proposition 13. 3j) (a) Fix a smooth curve C z in the family U z( zzC z and a 
base point * G C z . Then C° deformes to J^i^^i an d * moves to y G C° 
along a path 7*^. This implies that any loop lying on C z with base point * is 
homotopic to some loop lying on with base point yo- By Proposition 13.11 

the induced representation 



28 STEFAN MULLER-STACH AND KANG ZUO 

stabilizes the real subspace of W* C E™ which is the parallel transport of W yo ^y 
along the path 7- 1 . 

By assumption, the algebraic monodromy group H(Y°) is Q— simple. The cov- 
ering family is given by a correspondence in Y x Z and can be chosen such that 
there are finitely many curves through a generic point of Y . Therefore, after 
taking a generically finite base change Y ' — > Y°, we may assume that the family 
gives rise to a surjective map g : Y° — > Z° with connected fibres, and such that 
C° C Y° is a smooth fibre of g. Note that this modification does not change the 
algebraic monodromy group H(Y°) by (1) in Lemma [3.41 

By (2) in Lemma [3.41 there are two possibilities: either (i): H(C®) = H(Y°), or 
(ii): H(C®) is a finite group. The case (ii) is impossible. Otherwise the restricted 
representation p c o : 7i"i(C°*) — > Sp(2g, Q) would have finite image, which implies 
that the restricted period map ip : C° — > A g is constant. A contradiction. 

So we obtain H(C®) = H(Y°). Since p®o stabilizes W*, which is indeed an 
algebraic condition for the monodromy matrices of pco, the representation H(C®) 
in Vf also stabilizes W*. This shows that p®*(7Ti(y°,*)) stabilizes W*. Now by 
moving the base point * along the path j* yo to y we obtain that W yo€ Y,R is 
/9® fc (7T"i(Y°, 2/0 ) ) -invariant . The proof of (b) is the same as the one of (a). □ 

Corollary 3.5. Assume W yo£ Y carries a Q- structure from V® fc . Then the sub- 
system Uyo has finite monodromy and W yoe y extends to a subspace of sections of 




We assume now Y° is contained in a Shimura subvariety M° C A g of type 
SO{2,n) with toroidal compactification M C A g . Then V^ contains a sub- 
VHS of Hodge structures V, whose corresponding Higgs bundle has the form 

E = E 2 ' © E 1,1 © E ' 2 , 6 2 ' : T M (- \ogS M ) © E 2,0 ~ E 1 ' 1 , 9 1 ' 1 = 6 2 '°\ 

The Griffiths- Yukawa coupling for E along any subvariety Z C M meeting Sm 
transversely is the iterated Kodaira-Spencer derivative 
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The following statements and proofs will use this notation. 

Theorem 3.6. Let Y C A g be as above. Assume that Y° is contained in a 
Shimura subvariety M° C A g of type 50(2, n) We assume that Y and M intersect 
the boundary S of A g transversely, and that Y can be covered by a smoothing of 
a cycle ^2 li aiCi of special curves Ci C Y satisfying (HHP). Then: 

(a) IfW yo£ Y = Wj/og^m®^ for some y G C\ then Y° C M° is a special subvariety 
of orthogonal type. 

(b) If the Griffiths- Yukawa couplings along all Ci do not vanish then Y° C M° is 
a special subvariety of orthogonal type. 

(c) If the Griffiths- Yukawa coupling along Y vanishes then Y° C M° is a special 
subvariety of unitary type, i.e., a ball quotient. 

Remark 3.7. It is not hard to show that the assumptions of the theorem are 
necessary, since by Borcherds' results [I] any Shimura variety of type 5*0(2, n) 
contains sections of powers of automorphic line bundles which are unions of or- 
thogonal special subvarieties and components of Sm- 

One can show that f2y (log 5y) is nef on Y, and uy{Sy) is ample with respect to 
Y°. This follows from our transversality assumptions. 

In the assertions (a) and (b) of the theorem one may replace the assumption on 
the smoothing of the cycle OjCj of special curves Oj C Y satisfying (HHP) by 
the following: Assume that there is a connected union C± U • • • U C\ of special 
curves satisfying (HHP) and such that the image of 

has finite index for some basepoint *. 

Proof. Y° is contained in M°, which is a Shimura variety for 5*0(2, n) without 
compact factors. All Hermitian type subgroups of 50(2, n) except G = SL 2 x SL 2 
and quaternionic versions (see main theorem in |2~I] ) are Q-simple for rank reasons 
and either orthogonal or unitary. Hence H(Y°) will be Q-simple unless dim(Y) = 
2. In that case it follows that Y° is uniformized by a product H x HI of upper 
half planes. For the rest of the proof we may therefore assume that H(Y°) is 
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Q-simple and dim(Y) > 3. 

(a) By Prop. 13.31 (a) the real subspace W yo£ Y,R is p® 2 (7Ti(Y°, yo))-invariant. Hence 
W y0 £Y,R®^ defines a unitary subsystem TLJ of the local system W YC underlying the 
Higgs bundle E (see introduction) and a corresponding decomposition of Higgs 
bundles 

(E Y fi © E 1 / © E /, 9y) © (E l /\ 0). 

Note that 6 Y : -Ey 1 — >■ Ey 2 © fi y (log Sy) is surjective, since the pair (Y, Sy) is 
transversely embedded in (A g , S). Therefore we have rank-Ey 1 = dim Y, and 

i i" 

rankEy = dim W yQe y,R © C = dim W Voe y = dim M — dim Y 
This implies that 

6y : Ty (- log S Y ) © £y° -> E 1 / 

is an isomorphism. Hence the image of Y° in A g is a locally symmetric quotient 
of the period domain D of orthogonal type associated to the complement U of 
U in V. As a consequence, Y° M° is a totally geodesic embedding. Together 
with the rigidity of Y° C M°, which follows from dim(Y) > 2 [19] Lemma 1.5], we 
obtain that Y° C M° is a special subvariety of orthogonal type by the arguments 
in loc. cit.. 

(b) We will give two proofs. First Proof: The non-vanishing of the Griffiths- 
Yukawa coupling along Cj implies that 

Y' c , = V" ©U 1 ' 1 , 

where V" is a sub-VHS with rank one Hodge bundles 

E% © E%' © Efg := E% © 0(E$) © 9 2 {E 2 C % 

and Uq, is a sub-VHS of pure Hodge type (1,1). Hence Eq. is polystable of 
slope zero. Fix a base point ?/ G Cf. Then by Proposition 13.31 (b) the subspace 
W yo£ Y C W c >yo is p® 2 (7T 1 (Y°, y ))-i n variant. Hence the Higgs bundle E associated 
to Vy decomposes as 

(Ey fi © Ey V © £°' 2 , 0y) © (-Ey 1 ", 0) , 
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where the Higgs subbundle (Ey 1 , 0) corresponds to the unitary subsystem of 
rank equal to dim M — dim Y defined above. This implies that 

6 Y : Ty (- log S Y ) ® E y '° ->■ Ey 1 ' 

is an isomorphism. As in (a), Y° C M° is a totally geodesic embedding and the 
rigidity of Y° C M° implies that Y° C M° is a special subvariety of orthogonal 
type. 

Second proof for (b): Let (F Y ,6 Y ) C (E y ' u © E y ' © E [ p,6 Y ) denote the unique 
saturated Higgs subsheaf generated by E y '° and 0y. Then E y ' = E y ° and E y ' 2 = 
E y 2 , since the Griffiths- Yukawa coupling does not vanish. The non- vanishing of 
the Griffiths- Yukawa coupling along Cj implies that 

V^. = VeU 1 ' 1 , 

where V" is a sub-VHS with rank one Hodge bundles 

Ej° © E%' © E^ 

as above and C/^ 1 is a sub-VHS of pure Hodge type (1, 1). Using condition (HHP) 
for Ci C Y we see that 

i^lc = 9 Ci (T Ci (-\ogS Ci )^E^)®9 Nci/Y (N Ci/Y ®E%) 

= e£ ®e Nci/Y {N Ci/Y ®E 2 6 % 

where 9 Nc /Y (N Ci / Y <S>E^) is a direct factor of C/^ 1 . In particular det(F y ' 1 ) -C, = 
0. Hence, det(F y ' 1 ) -C 2 = 0, where C z is a smooth curve in the family U z( z Z C z and 
meets Sy transversely. Note that deg Fc z = 0, and by Simpson's polystability for 
the logarithmic Higgs subsheaf F Cz ,0 Cz C (E^ © E^ 1 © E^ 2 ,$c z ) we obtain a 
corresponding sub-VHS C V^. . Since H(Y°) is Q-simple, the same argument 
as in the first proof of (b) shows that extends to a sub-VHS over Y°, which 
uniformizes Y° as a special subvariety of orthogonal type. 

(c) The vanishing of the Griffiths- Yukawa coupling on Y implies that the Higgs 
subsheaf generated by E y and 6 Y has the form 

(F Y ,e Y ) = {E 2 /@e Y (T Y {-\ogS Y )®E 2 /),e Y ). 
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Therefore one has 

6 Y {T Y {-\ogS Y )®E 2 /)®0 Ci = 6c i {T Ci {-\ogScd®E 2 V)®6 Nci/Y {N Ci/Y ®Ey i i ). 
Note that in this case 

E 2 g = C, Eg = C- l ®C® U 1 ' 1 , 

where U 1,1 is polystable of degree zero and such that 

9 Ci : T Ci (-\ogS Ci ) ® C-^C~\ with C' 1 = e Ci {T Ci {-^gS Ci ) ® Eg). 

The condition (HHP) for all C; just means that 6 Nc /Y (N Ci / Y <8> Eg) is a direct 
factor of U 1 ' 1 , hence it has degree zero, too. That implies that det F Y -Ci = 0. By 
the same argument as in (b) we obtain that (F Y ,9 Y ) corresponds to a sub-VHS 
over Y°, which uniformizes Y° as a special subvariety of unitary type. □ 
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